
APPLICATION FOR U.S. PATENT 
TRANSMITTAL FORM 



TI-27109 



Attorney Docket No. 



AraJsbOant Commissioner for Patents 
Washington, DC 20231 



Sir: 



"EXPRESS MAILING" Mailing Label No. EM490248151US 
Date of Deposit: April 7, 2000. I hereby certify that this paper is 
being deposited wilii the U.S. Postal Service Express Mail Post 
Office to Addressee Service under 37 CFR 1.10 on the date shown 
above and is addressed to the Assistant Commissioner for Patents, 
Washington, D.C. 20231, 

C. Alan McCiure 



Transmitted herewith for filing is the patent application of: 
Inventor (s): Edwin R. Cole, David R. Thomas. 
For: Supply of Digital Audio and video Products 

ijnclosed are: 

'lwenty{20) sheets of formal drawings, forty-six (46) pages of Specification, 
fieclarat ion/Power of Attorney. (UNSIGNED) 



o 



VO 
LO 

U j 



K: FEE CALCULATION 


FEE 




NUMBER 




NUIMtBER 
EXTRA 


RATE 


BASIC FEE 
$ 760*00 


^^tal Claims 


46 


-20 


26 


$ 22 


$ 572.00 


■independent Claims 


6 


-3 


3 


X $82 = 


$ 246.00 


Total Filing Fee 
Assignment Recording Fee 


$1578.00 
$ N/A 


TOTAL FEES 


$1578.00 



This application claiios priority under 35 USC §119 to European Patent Application Serial 
No, 99400886,0 filed on April 9, 1999. Please charge to the deposit account of Texas 
Instruments Incorporated, Account No. 20-0668 in the amount of the Total Fees set forth. 
The Commissioner is hereby authorized to charge to the deposit account of Texas Instruments 
Incorporated, Account No. 20-0668, any additional fees which may be required, or credit any 
overpayment. This form is submitted in triplicate. 

All correspondence related to this application may be addressed to the undersigned at TEXAS 
INSTRUMENTS INCORPORATED, P.O. Box 655474, MS 3999, Dallas, Texas 75265. 



April 7, 2000 



Date 



C. ALAN MCCLURE 
Attorney for Applicant (s) 
Registration No. 31,041 



SUPPLY OF DIGITAL AUDIO AND VIDEO PRODUCTS 



Background Of The Invention 

5 The invention relates to the provision of digital audio or video products, for 

example over a network or in a pre-purchase Kstening or viewing kiosk. More 
especially, but not exclusively, the invention relates to the sale of such products over a 
pubhc network, such as the Internet or other similar public communication systems, 

A variety of techniques collectively known as digital watermarking has been 

10 developed to address the issue of unauthorized or illegal copying of digital video and 
audio products. Some such techniques result in a copied product being unviewable or 
inaudible. Other techniques block the copying of a watermarked original by open- 
circuiting the input stage of a video recorder (VCR) or other recording device when 
the correct watermark is not detected. Other techniques encode the source purchaser, 

15 or other information, to enable identification and tracking of unauthorized copies. 

Many digital watermarking techniques are specifically directed to copying 
from a physical recording medium, such as a compact disc (CD) or a digital video disc 
(DVD), However, the transfer of digital data streams between nodes of a network 
raises different issues as will now be described by way of an example. 

20 Conventionally, in a record store, it is possible for a customer to listen to an 

audio product prior to purchase for pre-purchase evaluation. This has proven to be an 
effective method for promoting sales and ensuring customer satisfaction with 
purchased products. However, in the context of Intemet sales of audio or video 
products, a customer is typically shopping at home or in another comfortable 

25 environment with an audio or video reproduction system or in an Intemet supported 
kiosk. In such an environment, unrestricted pre-purchase listening or viewing may 
compromise the purchase itself. 

A customer who abuses the system in this way would however not be making a 
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copy of the audio or video product. In effect, the seller would be copying the product 
by transmitting it to the potential buyer over the network. Conventional digital 
watermarking techniques would be ineffective, since there is no copying taking place. 

It is thus an aim of the invention to provide means by which a potential 
purchaser of a video or audio product can sample the product without compromising 
the purchase. 
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Summary Of The Invention 

Particular and preferred aspects of the invention are set out in the accompanying 
independent and dependent claims. Features of the dependent claims may be combined 
with those of the independent claims as appropriate and in combinations other than those 
5 explicitly set out in the claims. 

According to a first aspect of the invention, a server for a merchant computer 
system is provided that has a file store configured to store a range of audio/video 
products in respective product files, a dialogue unit operable to invite and receive a 
client selection from among the products, a product reader connected to read the 
10 product files from the file store to generate a digital audio/video signal, and a signal 
processing unit. The signal processing unit has an input selectively connectable to 
receive the digital audio/video signal from the product reader, a processing core 
n operable to apply a defined level of content degradation to the digital audio/video 

h signal, and an output connected to output the degraded digital audio/video signal. The 

^ 15 term "audio/video" is used to mean audio, video or both. 

4 It is therefore possible for a content provider to change the characteristics of an 

'^^ audio or video data stream supplied over a network or other public communications 

P system to a potential purchaser by degrading it in a controlled and variable manner. 

S| The amount of degradation is preferably sufficient to enable a potential purchaser to 

20 appreciate the characteristics of the audio or video product, whilst reducing the 
perceived quality. In addition, the changes to the characteristics of the audio or video 
data stream are preferably such that the original high-fidelity product cannot be 
reconstructed from the low-fideUty pre-purchase sample. 

Further aspects of the invention are exemplified by the attached claims. 
25 At this point it is noted that in this document references to purchase, buying, 

sale and the like are used to include other forms of transaction, such as loan, lease or 
license. 
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Brief Description Of The Drawings 

For a better understanding of the invention and to show how the same may be 
carried into effect reference is now made by way of example to the accompanying 
5 drawings in which: 

Figure 1 is a block schematic diagram of a computer network according to an 
embodiment of the invention; 

Figure 2 shows an embodiment of the server of the network of Figure 1 in more 

detail; 

10 Figure 3 shows internal structure of a digital signal processor for processing a 

digital video/audio signal according to one example; 

Figure 4 shows process flow for processing a digital video/audio signal using 
the digital signal processor of Figure 3 to manipulate the signal data in the frequency 
domain; 

15 Figures 5 A to 5F are schematic representations of data in the time and 

frequency domains showing operation of a band-reject filtering process; 

Figures 6A and 6B are schematic representations of data in the frequency 
domain showing operation of a phase inversion process; 

Figure 7A shows a delay line structure for degrading a bit stream conveying 
20 video or audio data according to another example; 

Figure 7B shows bit streams relating to the delay line structure of Figure 7 A; 

Figure 8 shows internal structure of a digital signal processor for processing a 
digital audio signal according to a further example in which a secondary signal is 
added; 

25 Figure 9 shows internal structure of a digital signal processor for processing a 

multi-channel digital audio signal according to a further example; 

Figure 10 shows internal structure of a digital signal processor for processing a 

multi-channel digital audio/video signal according to a further example; 

Figure 1 1 shows internal structure of a digital signal processor for requantizing 

30 a digital audio signal according to a further example; 

Figure 12 shows internal structure of a digital signal processor for imposing 
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time domain modulation on digital audio or video signal according to a further 
example; 

Figure 13 graphically represents a time modulation process applicable with the 
apparatus of Figure 12; 
5 Figure 14A and Figure 14B graphically represent another time modulation 

process applicable with the apparatus of Figure 12; 

Figure 15 shows a first form of masked sound insertion by way of a frequency 
domain representation of a digital audio signal; 

Figure 16 shows a second form of masked sound insertion by way of a 
10 frequency domain representation of a digital audio signal; 

Figure 17 shows the process flow for a combined masking and marking process 
as applied to a digital audio signal; 

Figure 18A is a frequency domain representation at one stage of the process of 
Figure 17; 

15 Figure 18B is a frequency domain representation at another stage of the process 

of Figure 17; 

Figure 19 shows a group of pictures in an MPEG video data stream; 

Figure 20 shows internal structure of the processing unit according to an 

example for processing MPEG video data; 

20 Figure 21 shows internal structure of the processing unit according to another 

example for processing MPEG video data; 

Figure 22 shows internal structure of the processing unit according to a further 

example for processing MPEG video data; 

Figure 23 shows internal structure of the processing unit according to a further 

25 example for processing MPEG4 video data; 

Figure 24 shows internal structure of a processing unit using analog processing 

techniques according to a first analog example; 

Figure 25 shows internal structure of a processing unit using analog processing 

techniques according to a second analog example; 

30 Figure 26 shows internal structure of a processing unit using analog processing 

techniques according to a third analog example; 
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Figure 27 shows internal structure of a processing unit using analog processing 
techniques according to a fourth analog example; 

Figure 28 shows an output stage of a server using a ship-ahead, play-once 
decoder; and 

Figure 29 shows an input stage of a cUent using a ship-ahead, play-once 
decoder. 
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Detailed Description 



Figure 1 is a block schematic diagram of a computer network according to an 
embodiment of the invention. The network comprises a customer computer system 
120, acting as a client, which has a communication Unk 160 to a merchant computer 
system 130, acting as a server. The customer-merchant communication operates under 
a general purpose secure communication protocol, such as the SSL protocol (Secure 
Sockets Layer which is a product of Netscape, Inc.). The merchant computer system 
130 has a conununication link 170 to a payment gateway computer system 140. The 
payment gateway provides electronic commerce services to the merchant computer 
system 130 from a bank computer system 150, acting as a host. The gateway 140 and 
bank computer system 150 are interconnected by a communication Unk 180 used for 
supporting customer authorization and the capture of transactions. The various 
communication links described above and later herein may include Hnks that have 
wireless portions, or may be a wireless link. 

The merchant to payment gateway communication link 170 operates under a 
secure payment protocol referred to as merchant-originated secure electronic 
transactions (MOSET) which is a kind of secure electronic transactions (SET) protocol 
developed by Visa and MasterCard. Other suitable secure payment protocols include: 
secure transaction technology (STT); secure electronic payments protocol (SEPP); 
Internet keyed payments (iKP); net trust; and cybercash credit payment protocol, to 
name but some. Generally, these secure payment protocols require the customer to 
operate software that is compUant with the secure payment technology. The protocol 
is used for interacting with the third-party certification authorities, allowing the 
customer to transmit encoded information to a merchant, some of which may be 
decoded by the merchant 130 and some of which can be decoded only by the payment 
gateway 140. Alternatively, the purchase could be enacted using a pre-authorized 
money card. 

Figure 2 is a block schematic diagram of elements of the internal structure of 

the server merchant computer system 130. A dialogue unit 135 is provided for 

interfacing with the client 120 and payment gateway 140 through the communication 
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links 160 and 170 respectively. The dialogue unit 135 is responsible for establishing 
and performing client-server and gateway-server communication. The server further 
comprises a file store 131 containing a range of audio/video products stored digitally 
in product files 133. A product reader 134 is also provided and is operable to read a 
selected one the product files and to output a digital data stream in a standard audio or 
video format, for example 16-bit CD audio or MPEG video. 

A data path links the output of the reader 134 to one side of a degrade switch 
136 which is connected in the illustrated position to route the reader output to an input 
8 of a signal processing unit 137 having a processing core operable to apply a defined 
level of content degradation to the digital audio/video signal. An output 16 of the 
signal processing unit 137 leads to an output of the server for connection to the client- 
server communication link 160. In another switch position (not illustrated) the 
degrade switch 136 routes the reader output directly for output to the client-server 
communication link 160. The position of the degrade switch 136 thus defines whether 
or not a signal output from the server for the client is routed through the signal 
processing unit 137. The position of the degrade switch is controlled by a control 
signal that is input from the dialogue unit 135 through a control line 138. 

The purpose of the signal processing unit 137 is to degrade the quality of an 
audio or video signal by a defined amount. In the present embodiment, the defined 
amount is variable, being set by a degrade level signal received from the dialogue unit 
135 through a control line 139 to the signal processing unit 137. The dialogue unit 135 
thus has a control function determining whether or not a signal is degraded when 
output, and by what amount. 

The amount of degradation applied is determined by a degrade level signal 

supplied over line 139 which is a scalar or quasi-scalar variable which can adopt 

values between a minimum or maximum. The minimum value can be set to provide 

no appreciable degradation, or a minimum non-zero level of degradation. The 

maximum value can be set to apply the maximum amount of degradation, for example 

for a known bad client, which renders the audio or video quality unacceptably low, 

even for evaluation purposes. The degrade level is computed having regard to a client 

integrity indicator determined from a personal chent file. A portion of the file store 
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131 is reserved for storing individual client files 132. The client files 132 include 
client history data, including past purchasing records. The degrade level may also be 
computed having regard to an authorization response received from the payment 
gateway 140 following an authorization request including a client i.d., a client payment 
5 instrument and a monetary value of the product selected for evaluation. The 
authorization response may include a credit rating factor as well as a simple YES/NO 
to the proposed transaction. It will also be appreciated that the degrade level 
computation may take account of both the client file content and the authorization 
response. 

10 An example of the operation of the e-commerce system of Figures 1 and 2 is 

now described. 

First, the client 120 establishes conmiunication with the server 130 to identify 
the customer. To do this, the customer computer system 120 initiates communication 
with the merchant computer system 130 through communication link 160 using any 

15 access protocol, for example transmission control protocol/internet protocol (TCP/IP). 
The customer computer system 120 acts as a client and the merchant computer system 
130 acts as a server. After exchanging hello messages, the cUent and server exchange 
authentication certificates and establish encryption protocols to be used for further 
communication, whereafter client-server communication is performed using the agreed 

20 form of the secure communication protocol. At this point, the dialogue unit 135 
searches the file store for a customer file 132 and creates a new customer file if none 
exists. 

The client transmits to the server information on the payment instrument to be 
used for payment for any products to be purchased. For example, a credit card number 

25 and user code number may constitute the payment instrument information. In order to 
obtain payment, the server must supply this information to the payment gateway 
responsible for the payment instrument tendered by the chent. This enables the server 
to perform payment authorization and payment capture. Payment authorization is the 
process by which permission is granted by a payment gateway operating on behalf of a 

30 financial institution to authorize payment on behalf of the financial institution. This is 

a process that assesses transaction risk, confirms that a given transaction would not 

TI-27109 -9- 



reduce the account balance below a threshold and reserves the specified amount of 
funds. Payment capture is the process that triggers the movement of funds from the 
financial institution to the merchant's account. 

Under control of the dialogue unit 135, the server then transmits to the client 
5 information on a range of video and/or audio products available for purchase, for 
example by reading header segments of a group of the product files 133. 

The cUent then transmits to the server an evaluation request for one of the 
products. The evaluation request is routed to the dialogue unit 135. 

The server then transmits a payment authorization request to the gateway 

10 specifying the requested product and the payment instrument data. The authorization 
request data includes all the information for determining whether a request should be 
granted or denied. Specifically, it includes information on the party to be charged, the 
amount to be charged, the account number to be charged, and any additional data, such 
as passwords, needed to validate the charge. This information is computed from the 

1 5 customer product selection. 

An authorization transaction is used to validate the payment instrument 
tendered by the customer for a prospective sale. Various payment instruments may be 
supported, selectable by the customer. Support can be included for credit cards, debit 
cards, electronic cash, electronic checks and smart cards, for example. 

20 For high value items, for example, the system may be configured so that the 

payment instrument's 'open-to-buy' amount is reduced by the authorized amount. 
This form of authorization, which may be referred to as pre-authorization, is thus 
analogous to a check-in transaction in a hotel where the minimum amount required for 
a customer's planned stay in the hotel is reserved. The transaction does not confirm a 

25 sale's completion to the host and there is no host data capture in this event. The server 
captures this transaction record and later forwards it to the host to confirm the sale in a 
forced post transaction request that confirms to a host that a completion of a sale has 
been accomplished and requests data capture of the transaction, 

A payment authorization response is then transmitted from the gateway to the 

30 server. If the authorization response is negative, then the dialogue unit 135 is 

configured to inform the client accordingly and request that another payment 
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instrument be tendered. If a further payment instrument is not tendered the session can 
either be terminated, or the product selection can be restricted to lower cost products 
that would not exceed the payment instrument's open-to-buy amount. On the other 
hand, if the payment authorization responsive is positive, the session proceeds as 
5 follows. 

The dialogue unit 135 computes a degrade level having regard to data held in 
the personal client file 132, the data contained within the authorization response 
received from the payment gateway 140, or both. A customer with an established 
track record of making purchases following evaluation sessions, and who tenders a 
10 payment instrument with a good credit rating, will score highly, so that the degrade 
Q level would be set low. On the other hand, a customer with an established track record 

of evaluation without purchase would receive a high degrade level. An unknown 
P customer would receive an intermediate degrade level, optionally with a weighting for 

m credit rating taken from the authorization response. 

;f ^ 15 On the basis of the computed degrade level, the dialogue unit 135 of the server 

130 will then output the switch control signal 138 to route the reader output through 

g the signal processing unit 137. Moreover, the dialogue unit 135 will output the 

■/'^ degrade level signal to the signal processing unit 137 to define the amount of 

□ degradation to be apphed to the product file data stream, which is then output to the 

20 client as a degraded evaluation version of the selected product. 

The pre-purchase evaluation phase is then concluded by the customer deciding 

whether or not to purchase the evaluated product. This is effected by a payment 

decision being transmitted from the client 120 to the server 130. 

If the customer payment decision is negative, then the dialogue unit 135 re- 

25 offers the product file range for a new selection. 

If the customer payment decision is positive the server transmits to the gateway 

a payment capture request for the previously authorized payment. Once payment 

capture processing is complete, this is communicated to the server from the gateway 

by way of a payment capture response. 

30 In the unUkely event that the payment capture response is negative, then the 

sale is aborted. On the other hand, if the payment capture response is positive, then the 
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dialogue unit 135 outputs the switch control signal 138 to route the reader output 
directly to the chent, i.e. without passing through the signal processing unit 137. 

To complete the sale, the server then transmits to the chent a non-degraded or 
high-fidelity version of the selected product. The high-fidelity version is preferably 
5 digitally watermarked to provide conventional copy protection and/or source tracking 
post purchase. 

Further details of suitable architecture for the client, server and gateway, and of 

the communication and payment protocols, can be found in WO 97/49055, the 

contents of which is incorporated herein by reference. For kiosk type transactions the 

10 product may be downloaded without degradation, but instead will include software 

providing a Umited number of plays or a short time frame for playing. 

Similarly, the specific sequence of transactions may be varied from the 

foregoing description. For example, information about the payment instrument may be 

provided to the server after a product has been selected for purchase. As another 

15 example, for prior customers, the amount of degradation is based upon historical data 

about a customer stored either on the server or at some other location. 

A number of processes for degrading the digital audio or video signal in a 

controlled manner are now described by way of example. 

In the following it will be understood that a video product often includes audio 

20 content and that examples referring to degradation of an audio data stream may be 

applied to degrade the audio content of a video product. Moreover, the degradation of 

an audio component of a video product, in certain situations, may serve as the sole 

means of degradation of the video product. 

Figure 3 shows intemal structure of the signal processing unit 137 which, in the 

25 following example, is based on a digital signal processor (DSP) 12 including a fast 

Fourier transform (FFT) unit 50 for performing discrete Fourier transforms (DFT's) 

from the time domain to the frequency domain, and an inverse FFT unit 52 for 

performing inverse DFT's from the frequency domain to the time domain. The DFT 

and inverse DFT algorithms may be embedded in hardware or may be defined in 

30 software and implemented in hardware in a general computational unit of the DSP 12, 

or may be combinations of both. 
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The signal processing unit 137 receives the digital data stream at the input 8 
and supplies the digital data stream to a decoder 10 for decompressing the digital data 
stream from a known standard, such as MPEG2 or MPEG4 for video or audio signals, 
or 16-bit CD for audio. The decompressed digital data stream is then processed by the 
5 DSP 12 to achieve degradation of the perceived video or audio quality. The degraded 
signal is then supplied to an encoder 14 and re-compressed to the format of the original 
coding standard received at the input 8. Although depicted in Figure 3 as separate 
blocks, decoder 10 and/or encoder 14 may be implemented as software running on the 
DSP 12. For certain digital data, decoder 10 and encoder 14 may not be required. 
10 For audio signals, the DSP 12 may act as a frequency domain modulator. The 

□ decoded digital data stream is subjected to a DFT in the FFT unit 50 in order to 

■ fi 

j|5 transform the data into the frequency domain where a signal-degrading modulation is 

P applied by manipulation of the frequency coefficients. The modulated frequency 

if! domain spectrum is then transformed back into the time domain through the 

l: I 15 appUcation of an inverse DFT by the inverse FFT unit 52. 

Figure 4 shows the process flow generic to frequency domain modulation 
^ techniques in which the signal is transformed into the frequency domain in Step S2 by 

the FFT unit 50, manipulated in the frequency domain in Step S4 by a frequency 

□ domain modulation unit 51, and then transformed back into the time domain in Step S6 
20 by the inverse FFT unit 52. 

Figures 5A to 5F show a form of frequency domain modulation that may be 
used, namely band-reject filtering, sometimes referred to a notch filtering. 

Figure 5A is a continuous representation of an amplitude modulated signal in 
the time domain A(t) as conveyed by the digital audio signal. Owing to its finite 
25 nature, the digital audio signal will of course only convey a sampled representation of 
A(t) in reality. 

Figure 5B shows the digitized or discretized version of the same function 
namely {An(t)}. 

Figure 5C shows the same discrete function now in the frequency domain 

30 {An(f)} after application of the DFT in Step S2. Frequency components in the range 

fmin to fmax are showu, these frequencies representing the lower and upper bounds 
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respectively of the audio frequency range to be transmitted. This range will usually be 
the full humanly audible frequency spectrum or a sub-set thereof. 

Figure 5D shows the manipulated function {A'n(f)} after application of band- 
rejection in the frequency range fi to f2. The band rejection is achieved by setting the 
5 frequency coefficients An to zero or near zero values for all frequencies between f i and 
f2. 

Figure 5E shows the discrete form of the manipulated function as transformed 
back into the time domain namely { A'n(t)} as supplied to the encoder 14. 

Figure 5F is a continuous representation of the manipulated function A'(t). 

10 The center frequency and passband width of the band-reject filter can be 

selected based on a pseudo-random number sequence with a very long period. The 
audio stream can then be processed with the notch filter to change its spectral 
characteristics. In addition, the center frequency and passband width can be changed 
periodically. The pseudo-random number sequence can be varied, for example 

15 according to the time of day. 

Another form of frequency domain modulation that may be used is low-pass 
filtering to remove, or attenuate, spectral components above a selected frequency. If 
the high-frequency components are attenuated, rather than being removed, high- 
frequency noise is preferably added to prevent restoration of the high quality original 

20 signal by a filter which compensates for the attenuation. Instead of, or as well as, low- 
pass filtering, the DSP 12 may be configured to perform high-pass filtering, or 
attenuation below a selected frequency. Similar design considerations apply as for 
low-pass filtering. In each case the process flow follows that shown in Figure 4. 
Moreover, referring to Figures 5A to 5F, these other kinds of frequency modulation 

25 can be understood as differing from the band-reject filter example only in that the 
modulation technique applied is different from that shown in Figure 5D. 

Figures 6A and 6B shows a further example of frequency-domain degradation 
applicable with a DSP. This example relies on modulation in the frequency domain 
using apparatus as described above with reference to Figure 3 and Figure 4. In this 

30 example, the frequency domain signal An(f) is subdivided into a plurality of frequency 
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ranges Afk to which frequency or phase inversion is selectively apphed dependent on 
the degrade level signal which thus serves as a control signal for activating selected 
ones of the inversion ranges so as to apply phase inversion to none, one or more of the 
frequency bands. 

5 Figures 6A shows the digitized frequency domain signal An(f) and is thus 

comparable with Figure 5C in the band-rejection filter example. 

Figure 6B shows the modulated signal after frequency inversion within two 
frequency bands Afi and Af2. 

Otherwise, the FFT and inverse FFT process steps are as described with 
10 reference to Figures 5A to 5F. 
^3 The frequency bands selected for inversion may be varied with time, for 

I jl example in a random or pseudo-random fashion, or by sequential polling, thereby to 

provide a further subjective impression of quality degradation in the output signal and 
y ^ to provide a further barrier to distortion removal by a hacker. In its simplest form, 

Ij 15 there may be provided only a single phase inversion band. 

In the above frequency domain modulation examples, the degrade level can be 
:p used in determining the range of modulated, removed or attenuated frequencies 

according to the subjective significance of the frequencies of concern to a listener. 

Figures 7 A shows internal structure of another example for producing signal 
20 degradation which may be implemented in hardware or software using a DSP 12. The 
digital data stream is received through the input 8, fed through a delay line structure 
and output through the output 16. The delay hne structure includes a shift register 60 
with a bank of taps 65 which can be selectively turned on and off by respective 
switches 64 responsive to the degrade signal 139. The taps 65 are tied together with a 
25 feedback line to the input end of the shift register 60 with respective adders 66, there 
being a further adder 67 arranged to combine the input digital data stream from input 8 
with the feedback signal stream from the taps 65. The feed back structure of the taps 
and adders thus form circuitry that acts to inject noise into the digital data stream by 
manipulation at the bit level. The degrade level signal 139 is received at a further 
30 input in the form of a 3-bit binary signal having one of eight values in a range 0 to 7. 
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The degrade level signal is supplied to a unary converter which generates an 8-digit 
unary representation of the 3-bit binary degrade level, each bit of the unary 
representation controlling one of the tap switches 65. With this arrangement, the 
higher the degrade level, the more taps are closed, so the greater the amount of signal 
5 degrading feedback is provided. In operation, if a tapped binary value is zero then this 
will feed back to the shift register input as a zero and not have any effect. On the other 
hand, if the tapped binary value is one, then this will be fed back as a one and will set 
the digital data stream bit at the output of the adder 67. 

Figure 7B is a graph showing schematically a number of bit stream traces. The 

10 uppermost trace, labeled IN, shows the digital data stream received at the input 8, The 
next trace, labeled FB, shows the feedback signal 69 as supplied to the adder 67 when 
a certain number of the switches 65 are closed, thus opening their corresponding taps 
65. The next trace, labeled MOD, shows the signal 68 output from the adder 67, i.e. 
the additive combination of the two signals shown in the upper traces IN and FB. In 

15 the arrangement illustrated in Figure 7 A, only the two bits shown with vertical arrows 
in Figure 7B are changed, since the other bits set as a result of the feedback were 
already set in the incoming data stream. 

In an altemative arrangement, the adder 67 shown in Figure 7A could be 
substituted with an exclusive OR combiner so that a one appearing on the input of the 

20 exclusive OR from the feedback hne would have the effect of toggling the bit on the 
data stream received from input 8. The resultant bit stream with input signals IN and 
FB is shown with the lower trace of Figure 7B, labeled MOD(OR). 

Figure 8 shows another example of DSP implementable manipulation of a 
digital audio signal for degrading perceived signal quaUty. Again, this example may 

25 be implemented in hardware or software using a DSP 12. In this example, a data 
generator 18 is provided, the output of which is supplied to adder 20. The value to be 
added by the adder 20 is controlled by the degrade level conveyed by the digital 
degrade level signal 139a. The output of the adder 20 is received at one input of an 
adder 22, the other input of which receives the high-fidelity digital data stream 

30 received at the input 8 from the reader 134. The adder 22 thus serves to add to the 

high-fidelity digital signal a secondary digital signal generated by the data generator 
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18, the secondary digital signal having a number of bits defined by the degrade level. 
Finally, the output of the adder 22 is supplied to the output 16 for the client 120, 

The data generator 18 may be a source of pseudo-random data. For example, 
the signal generator 18 may be a pseudo-random data generator with a very long 
5 period used to generate low-level audible noise with desired spectral and/or temporal 
characteristics. Especially for classical audio recordings, the data generator may 
generate the data to emulate the form of one or more of the rumble, hiss and popping 
of an old, possibly scratched, vinyl or acetate recording. 

As an alternative to noise-type effects, the data generator 18 may be a source of 
10 a secondary content-based audio signal, for example a speech bearing signal. In the 
case of a music product, the speech signal generated by the signal generator 18 can 
thus be added to cause a voice-over of the music, thereby spoiling the appreciation of 
the music. This could be achieved with a D.J. voice-over for popular beat music or a 
monotonic nasal announcer for classical music. The music can thus be rendered 
15 unusable for high quality listening, while still allowing the Ustener to verify that the 
correct audio stream has been selected, and that the music is worthy of purchase. 

Figure 9 shows a further example configuration of the processing unit 137 
suitable for implementation in hardware or software using a DSP 12. This example is 
applicable to audio signals. An audio signal comprising a plurality 'n' of channels is 
20 received at the input 8. The audio signal is preprocessed into a vector form by a pre- 
processing unit 24 and then supplied to a n-channel filter unit 26 for processing prior 
to output to the n-channel output 16. The processing unit 137 further comprises a 
matrix unit 28 in which is stored a matrix defining the mapping between the input 
channels and the output channels, that is between the channels output from the reader 
25 134, and the channels to be output to the client 120. In the case of 5.1 channels, such a 
matrix would be as follows, in the case that no degradation was to be applied : 

Output Channel 

Input L C R Ls Rs LFE 

Channel 
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L 


1.0 


0 


0 


0 


0 


0 


C 


0 


1.0 


0 


0 


0 


0 


R 


0 


0 


1.0 


0 


0 


0 


Ls 


0 


0 


0 


1.0 


0 


0 


Rs 


0 


0 


0 


0 


1.0 


0 


LFE 


0 


0 


0 


0 


0 


1.0 



L, C and R signify left, center and right channels, respectively. Ls and Rs 
signify left and right surround channels, respectively. LFE signifies low frequency 
effects. 

5 As will be appreciated, the above matrix is the n x n identity matrix. If no 

attenuation or amplification is intended, the numerical sum of the magnitudes of the 
elements in the matrix should always equal the number of channels, in this case six. 

To generate degradation, a non-identity matrix is used. For example, the 
following matrix can be used to switch the left (L) and right (R) channels: 

10 

Output Channel 



Input 


L 


C 


R 


Ls 


Rs 


LFE 


Channel 














L 


0 


0 


1.0 


0 


0 


0 


C 


0 


1.0 


0 


0 


0 


0 


R 


1.0 


0 


0 


0 


0 


0 


Ls 


0 


0 


0 


1.0 


0 


0 


Rs 


0 


0 


0 


0 


1.0 


0 


LFE 


0 


0 


0 


0 


0 


1.0 



Spatial modification of the signal for signal degradation can thus be performed 
by performing a matrix multiplication in the n-channel filter unit 26, the operands 
being the transfer function matrix stored in the matrix unit 28 and the 1 x n matrix, i.e. 
15 vector, presented by the pre-processing unit 24. As illustrated schematically, the n x n 



TI-27109 



-18- 



matrix can be modified periodically at intervals of time At so that the spatial 
modification of the audio signal continually changes. Each clock trigger CLK 
occurring at the time intervals At induces a recomputation of the transfer function 
matrix by a computation unit 30 provided for this purpose. It will be understood that 
5 the time interval At may be allowed to vary in a random or pseudo-random fashion and 
need not represent a fixed time interval In this example, the degrade level signal 139a 
may or may not be utilized. If utilized, the degrade level signal is supplied to the 
computation unit 30 and used to control the selection of the transfer matrices. 

In a modification of this example, the n-channel filter unit 26 may incorporate 
10 head related transfer functions (HRTF's). These are functions that can be used to 
Q position audio sources at a selected azimuth and elevation around the listener. The 

ijl individual channels of a multichannel audio stream can be perceptually moved around 

by appropriate filtering with HRTF's. The HRTF's are computed in the computation 
unit 30 and stored in the n-channel filter unit 26. The HRTF's are changed 
^ 15 periodically at intervals of time At as described above. Individual channels will then 

be perceived as moving around by the listener, thereby degrading the quality of the 
sound. 

\| In a farther alternative to the channel switching example, random or periodic 

:5 phase inversion of the channels can be created to simulate unmatched speakers. Using 

20 the above switching matrix, a negative value will represent a phase inversion for a 
given output channel. For example, inverting the phase of the left (L) and left 
surround (Ls) channels is achieved with the following transfer matrix: 

Output Channel 



Input 


L 


C 


R 


Ls 


Rs 


LFE 


Channel 














L 


-1.0 


0 


0 


0 


0 


0 


C 


0 


1.0 


0 


0 


0 


0 


R 


0 


0 


1.0 


0 


0 


0 


Ls 


0 


0 


0 


-1.0 


0 


0 
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Rs 0 0 0 0 1.0 0 

LFE 0 0 0 0 0 1.0 



It will thus be understood that the channel switching procedure can be used to 
induce phase distortions as well as spatial modifications in an audio signal 

The apparatus of Figure 9 may also be used for channel removal or attenuation. 
5 This can be effected by setting the appropriate matrix elements to zero, or by dividing 
the appropriate matrix elements by an attenuation factor. In this way, x channels of an 
n channel signal can be removed or attenuated. 

For a multi-track audio recording where different instrument and vocal tracks 
are available on separate channels, channel removal may serve to remove one or more 
10 instruments from the multi-track recording. This technique requires one channel per 
track and will thus be possible for database master recordings, but not for 16-bit CD 
audio standard where the spectral content of each instrument or voice is not separately 
available. 

For a combined video and audio signal, the audio channel may be removed 
15 completely. 

Figure 10 shows a further altemative structure for the processing unit 137. 
This structure may be used for degrading audio or video signals using hardware or 
software in a DSP 12. In the case of an audio data stream consisting of two or more 
channels, the channels can be mixed to produce a monophonic playout. The digital 

20 data streams are received at the inputs 8 and digitally mixed in a mixer 32 prior to 
output as the digital equivalent of a monophonic signal to the output 16. The output is 
shown schematically in the drawing as a single channel output, but in practice may be 
an n-channel output with each channel carrying a monophonic signal. 

Figure 11 shows a further example of a signal degradation technique suitable 

25 for apphcation with a DSP, This example is for digital audio signals. An n-bit digital 

audio signal is supplied to the input 8, The signal may for example be a 16-bit signal. 

The signal is then processed by a requantization unit 42 which digitally requantizes the 

audio stream by to generate a digital audio signal of m bits, where m<n. The m bits 

then form the most significant m bits of an n-bit signal in which the m-n least 
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significant bits are zeros. In this way, a n-bit audio signal can be output, but one that 
only has m bit resolution. For example, a 16-bit digital audio signal can be reduced to 
12-bit audio quality. If the degrade level signal (not shown) is to be used, then this 
may be received at the requantization unit 42 with the value of m being varied 
5 according to the degrade level signal. 

Figure 12 shows a further example of the internal structure of the processing 
unit 137. Again, this example may be implemented in hardware or software using a 
DSP 12. A time modulation unit 44 is operatively interposed between the input 8 and 
output 16 and serves to apply a time-domain modulation to a video or audio signal, for 

10 example using a DSP. 

Time-domain modulation may be a random, pseudo-random, or regular speed- 
up or slow-down of the data stream. This may for example use well-known re- 
sampling and interpolation techniques. The sampling frequency of the data stream 
may be varied randomly, cycUcally, or in a pseudo-random fashion. 

15 One implementation of time modulation is specifically applicable to a digital 

signal with both video and audio content, wherein the audio content preferably has a 
musical or vocal contribution. In this implementation, time modulation is performed 
by a processor, preferably a DSP, to modulate the perceived time scale of the audio 
content, preferably the musical or voice content. The processing algorithm may be 

20 based on an overlap and add (OLA) algorithm, or a modified version thereof referred 
to as SOLA, as described in US Patent No. 5,749,064 (Pawate and Yim) the contents 
of which is incorporated herein by reference. Alternatively one of the alternative time 
modulation algorithms referred to in this US patent or the time modulation algorithms 
disclosed in the documents cited during prosecution of this US patent may also be 

25 used, the contents of which are also incorporated herein by reference. These time 
modulation methods have found use in Karaoke machines and are known from that art. 
In the context of the present embodiment, the time modulation is applied to change the 
key or pitch of a musical or voice channel or channels. For example, in a movie or 
music video, a male voice may be effectively changed to a female voice or vice versa, 

30 thereby to degrade appreciation of the product. This technique may also be used to 

process one or more channels of an audio signal in which the separate tracks are 
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available, such as in a master recording. For example, the lead vocal track or tracks of 
an operatic or popular music recording may be processed by time modulation in this 
way. 

Figure 13 shows one form of time modulation of a data stream An(t) in which 
5 the analog envelope Eo (dot-dashed line) of the original signal An(t) is modulated to 
form a modified signal A'n(t) having an analog envelope Em (dot-dash-dash line). This 
is achieved in the illustrated example by randomly increasing and decreasing the value 
of each datum, for example to vary the volume associated with each 16-bit word in the 
case of a 16-bit sampled CD audio data stream, or to vary the luminance or 

10 chrominance information of individual data blocks in a video data stream. 

Figure 14A and Figure 14B show another form of time modulation in which 
the sampling period is effectively doubled by setting the value of every other datum to 
the value of the preceding datum. Thus an input data stream A(in) as shown in Figure 
14A, consisting of successive data elements of amplitude Ai, A2, A3, A4, A5, Ae etc. is 

15 modulated into an output data stream Ai, Ai, A3, A3, A4, A4 etc., as shown in Figure 
14B, with the data values for the even numbered data elements being written over by 
the immediately preceding data value. The sampling period can be lengthened by any 
desired factor, not just two, and with a variety of other techniques. This technique is 
apphcable to video as well as audio data streams. In the context of video, the sampling 

20 frequency may be that of the frame rate so that lengthening the sampling period 
corresponds to lowering the frame rate. In MPEG video, reducing the sampling period 
may also correspond to picture element amalgamation so that the number of 
independent picture elements per block is reduced. For example an 8x8 pixel block 
may be reduced to 4x4 resolution by overwriting the even numbered pixels in each 

25 row or column with the data values of the immediately preceding odd numbered 
pixels. 

The time modulation may also take the form of a non-linear compression or 

expansion which modifies the data stream, for example randomly. (Compression is a 

non-linear modification of the signal to make the resulting analog envelope more 

30 uniform and expansion is the reverse process of making the resulting analog envelope 

less uniform). In a digital audio signal, compression may for example take the form of 
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injecting bits into the frequency mid-range and removing bits from the high frequency 
range. 

In the following, examples of frequency and time domain masking and 
marking techniques are discussed as used to process digital audio signals for pre- 
5 purchase listening. The masking and marking techniques can be implemented by a 
DSP of the kind shown in Figure 3. 

Masking is first described. The phenomenon of auditory masking causes high- 
ampUtude sounds to mask lower-amplitude sounds which are located nearby in 
frequency or time. Masking in the following examples is effected by the insertion of 
10 frequency components, as viewed in a frequency domain representation of a digital 
audio signal, in such a manner that there is little or no perceived change in the 
perceived fidelity of the audio signal. 

The masking process may be combined with a signal degradation process or 
may be non-degrading and performed separately from the signal degradation process. 
15 Examples of independent, non-degrading masking processes are described first. 

(In these examples it is assumed that the signal is degraded by a separate process, for 
example by one of above-described frequency or time modulation techniques). 

When in the frequency domain, frequency components which constitute 
amplitude peaks with an ampHtude greater than a threshold amplitude are determined. 
20 Figure 15 shows one amplitude peak occurring at a frequency fp and having an 
amphtude Ap. As shown in Figure 15, the frequency coefficients lying within a 
frequency band of width Af centered around the frequency of the amplitude peak are 
set to an amplitude Am. The mask bandwidth Af and mask amplitude Am are set to 
values known to produce no significant humanly audible change in the signal. The 
25 values may be dependent on peak frequency fp and also peak amplitude Ap. Instead of 
setting all the amplitudes to the same value Am within the mask bandwidth, a 
functional envelope could be used to define Am(f). 

In a modified example, shown in Figure 16, the frequency coefficients lying 
within a frequency band of width Af centered around the frequency of the amplitude 
30 peak of amplitude Ap are incremented by an increment AA known to be imperceptible 
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to a listener. The size of the increment may be a function of the peak amplitude and 
peak frequency fp. The added contributions are said to be "masked" since they cause 
no perceived change in the reproduced sound. 

In the above examples, the masking process is performed in the frequency 
5 domain. Referring to the degradation example illustrated in Figures 5A to 5F, the 
masking process can be performed before or after the signal-degrading frequency- 
domain modulation shown in Figure 5D. If signal degradation is based on modulation 
in the frequency domain, then masking is preferably performed concurrently with the 
signal-degrading frequency domain modulation. However, if the signal degradation is 

10 not performed in the frequency domain, then masking will be performed as a separate 
process and include FFT and inverse FFT steps. 

An example of a combined degrading and masking process is now described 
with reference to Figure 17 and Figures 18A and 18B. 

As shown in Figure 17, a digital audio signal is input at 8 and is convolved 

15 with a mixing frequency fm in a mixer 53. The output of mixer 53 is subjected to a 
DFT in an FFT unit 50 and thus converted into the frequency domain. The frequency 
domain signal may appear as shown schematically in Figure 18A and will generally 
include negative frequency components and non-zero frequency coefficients outside 
the frequency range fmin to fmax of interest. The frequencies fnun and fmax may for 

20 example define a frequency range bounded by the lower and upper frequencies to 
which the human ear is responsive, or a sub-set of the audible frequency range. The 
frequency domain signal is then modulated in the filter unit 51 by removal of the 
negative and out-of-range frequency components as shown in Figure 18B. Masked 
frequency contributions are then added to the frequency domain signal around the 

25 mixing frequency fM which will have a significant amplitude. The masked frequency 
contributions may be added in the manner described with reference to Figures 15 and 
16, and associated text, where fM is treated as the peak frequency fp. Moreover, it will 
be understood that in this example peaks other than the peak at the mixing frequency 
may be identified for the insertion of masked contributions, as also described with 

30 reference for Figures 15 and 16. 

Marking is the variation with time of the mixing frequency fM so that fM=fM(t). 
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Time variation may take the forai of a framewise variation in a digital video signal or a 
frequency modulation type effect in an audio signal, for example. Referring to the 
apparatus of Figure 17, the mixer 53 mixes a frequency fM with the input signal and 
the filter 51 trims the signal to remove negative and out-of-range frequency 
components. Figure 18A and 18B are thus also representative of masking. 

To eUminate the degrading effect of the mixing frequency, a hacker would 
have to establish the time evolution of the mixing frequency along the digital data 
stream, i.e. the nature of fm(t), which would be a difficult task. By using a randomly 
assigned mixing frequency to modulate selected frequency ranges of music, for 
example, one can degrade the spectral quality of the music in a controlled manner. 
Any attempt to reconstruct the original music using demodulation would require the 
use of exact mixing frequencies at exact frequency ranges. If erroneous mixing 
frequencies or erroneous frequency ranges are used, then the music will not be 
reconstructed and would be further degraded by the attempted reconstruction 
procedure, since anomalies would be introduced into other parts of the audio spectrum. 

More generally, the purpose of masking the degraded signal in embodiments of 
the invention is to make it more difficult for a hacker to reconstruct a high-fideUty 
signal from the degraded digital audio signal. The removal of the deliberate 
distortions inserted to degrade signal quahty is rendered more difficult by masking, 
since any attempt to manipulate the signal using Fourier transform, correlation, 
deconvolution or related techniques would tend to redistribute at least part of the 
energy associated with the masked frequency components away from the cover of the 
associated amplitude peak. As a result, the noise or tones that were added so as to be 
masked will become unmasked and thus audible. Manipulation of the degraded digital 
audio signal by a hacker would thus tend to degrade the fidelity still further. 

Marking will also tend to have the same effect, i.e. the effect that speculative 

manipulation will further degrade the degraded digital audio signal. If a hacker 

attempts to cancel the mixing frequency fM by deconvolving with a guessed mixing 

frequency fp then this will be a highly laborious process, since the frequency will vary 

with time in a non-simple functional form. 

Furthermore, if marking and masking have been used in combination to insert 
TI-27109 -25- 



masked sound around the mixing frequency then it will be even more difficult for the 
hacker, since, in an iterative hacking process, it will be still more difficult to find a 
convergence between fo and fM. 

In addition to frequency domain masking, it will be understood that known 
5 time domain masking processes may also be appUed to add masked noise, tones or 
instruments. 

Apparatus and processes for manipulating MPEG digital video data streams to 
degrade perceived content quality are now discussed. To aid understanding of the 
degradation techniques, a brief sunmiary of some basic features of MPEG2 and 

10 MPEG4 are first described. 

An MPEG2 or MPEG4 video sequence is made up of data packets each 
containing header codes and a group of pictures (GOP). In turn, a GOP is made up of 
a plurality of pictures or frames. Each picture is made up of picture elements (pixels) 
which are grouped into blocks, typically of 8x8 pixels. The blocks are in tum 

15 combined into macro-blocks which contain, k blocks of luminance information, 1 
blocks of chroma information for the color difference CB, and m blocks of chroma 
information for the color difference CR. The macroblock size is referred to as (k,l,m), 
where k is usually 4, 1 is usually 2 or 4, and m is usually 0, 2 or 4. The macroblocks 
are combined to form slices, and the slices combined to form a frame. 

20 MPEG2 and MPEG4 use three different types of frames, namely I-frames, P- 

frames and B-frames. A typical MPEG frame sequence of a GOP is shown in Figure 
19. 

Referring to Figure 19, a GOP having 12 compressed frames is shown. The I- 
frames are stand-alone frames containing all the data necessary to display a still image. 

25 By contrast, the P- and B-frames both require reference to other frames of the GOP to 
allow reconstruction. P-frames use a single previously reconstructed I- or P-frame as 
the basis for prediction calculations. B-frames use both forward and backward 
interpolated motion prediction to reconstruct a frame on the basis of both past and 
future reconstructed I- and P-frames. Thus, I- and P-frames serve as a basis for 

30 reconstruction of future P- or B-frames, As a consequence, I-frames in the GOP are 

the seed for all P- and B-frames, both P- and B- frames being reconstructed from I- 
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and P-frames. To reduce the bandwidth requirements, the MPEG standards are 
designed to allow a certain number of P-frames to be inserted between each I-frame 
and, in turn, a certain number of B-frames to be inserted between the P- and I-frames. 
In Figure 19, for example, an I-frame occurs every twelfth frame with intervening P- 
5 frames every fourth frame and two B-frames between the adjacent I- and P-frames. 

In addition, MPEG2 and MPEG4 make use of the concept of two-dimensional 
motion vectors to increase data compression when video sequences contain movement. 
In MPEG2 macroblocks are the basic element for motion vector calculation. In 
MPEG4, objects are the basic element for motion vector calculation. The frames of 

10 the GOP refer to macroblocks or objects in terms of their speed and direction, thereby 
to allow reconstruction of B-frames in particular on a predictive basis. 

Figure 20 shows a first example of the signal processing unit 137 for 
degradation of content quaUty of an MPEG digital video stream. In this example, the 
signal processing unit 137 preferably comprises a DSP. 

15 The MPEG data stream is clocked into an input buffer 46 in a frame wise 

manner under the control of a controller 47. The controller 47 acts to determine the 
frame type of the frame held in the input buffer 46. If the frame type is identified as 
type I or B, then the frame is transferred to an output buffer 48. On the other hand, if 
the frame type is identified as type P, then the frame is held in the input buffer 46. In 

20 both cases, the controller clocks the output buffer 48 to output the frame held therein 
to the output line 16. The P-frame held in the input buffer 46 is overwritten without 
ever having been transferred to the output buffer 48 when the next frame is clocked in. 
The controller 47 is arranged to receive the degrade level signal 139b and in response 
thereto selectively intervene to overwrite only a fraction of the P-frames, where the 

25 fraction overwritten is proportional to the degrade level. 

In this way, P-frames are overwritten with the immediately preceding B-frame. 
The lower part of Figure 20 illustrates the output sequence using the GOP shown in 
Figure 19 as the input received at the input 8 for the case that all P-frames are to be 
overwritten. As illustrated, the apparatus shown in Figure 20 has the effect of 

30 overwriting the frames P4 and P7 (shown dotted) with the frames B3 and Bg 

respectively. By replacing the P-frames with their immediately preceding B-frames, 
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picture quality will be degraded since cumulative errors will build up in the B-frames 
as a result of their interpolation from more remote I- and P-frames. This degradation 
process has the advantage that no manipulation of the data itself is required so that the 
amount of processing activity is relatively low. 
5 Figure 21 shows a further example of the signal processing unit 137 for 

degradation of content quality of an MPEG digital video stream, for example a video 
stream conforming to MPEG2 or MPEG4. In this example, the signal processing unit 
137 preferably comprises a DSP. As illustrated in Figure 21, a frame buffer 46 is 
operatively inserted between the input 8 and the output 16. A motion vector 

10 manipulation unit 72 is arranged to identify and modify the motion vector data of a 
frame held in the frame buffer 46. The modification may be by way of imposing a 
random incremental change to the motion vector. The motion vector manipulation unit 
72 may be arranged to modify only the motion vectors of selected frames, for example 
P-frames. The size of the motion vector modification can be made dependent on the 

15 degrade level signal 139c received at an input of the vector manipulation unit 72. The 
errors introduced in the P-frames will then propagate automatically through to 
dependent B-frames when the GOP is reconstructed for playback. However, the extent 
of the degradation cannot become uncontrolled, since the I-frames will refresh the 
image correctiy at the beginning of each GOP. 

20 Figure 22 illustrates another example of the signal processing unit 137 for 

degradation of content quality of an MPEG digital video stream, also suitable for 
MPEG2 or MPEG4. In this example the data is manipulated at the block level. 
Digital video data is transmitted through a frame buffer 46 and a frame identifier 74 is 
arranged to look at the buffer 46 and identify the frame type. If the frame type is I- 

25 type then the frame identifier 74 acts to close a switch 75 to route a noise contribution 
generated by a pseudo-random signal generator 76 to one input of an adder 77 the 
other input of which receives the digital video data from the frame buffer 46. In this 
way noise contributions are added to the blocks. Noise may be added only to the 
luminance blocks, or only to the chroma blocks of the macroblocks, or to both 

30 luminance and chroma data. The level of noise can be controlled by the pseudo- 
random signal generator 76 responsive to the degrade level signal 139d received 
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thereby. Preferably, noise is only added to the I-frames, since this has the maximum 
degradation effect for the least processing, since noise in the I-frame will be 
propagated through all dependent P- and B-frames. However, it will be understood 
that the frame identifier 74 and switch 75 could be omitted in which case each frame 
5 will have noise added to its data blocks. 

Figure 23 illustrates another example of the signal processing unit 137 for 
degradation of content quality of an MPEG4 digital video stream. In this example, an 
object identifier 78 is arranged to identify an object in a frame held in an input-side 
frame buffer 46a arranged to receive data from the input 8. The object identifier 78 is 

10 arranged to output an identifier for an identified object to an object manipulation unit 
79 which in turn manipulates the object concerned in the frame clocked through to an 
output-side frame buffer 48a. Manipulation may take the form of object removal or 
replacement of the object with a dunmiy object, which may be selected randomly from 
a library, for example. Alternatively, the object identifier may be configured to 

15 identify two or more objects, in which case the manipulation may take the form of 
interchanging the object positions within the frame. It will be appreciated that this 
example is applicable not only to MPEG4, but also to any other MPEG or other 
standard that uses objects. 

Referring back to the examples of Figures 20 to 23 it will be understood that 

20 the various degradation processes may be combined cumulatively. For example, noise 
insertion into I-frames may be readily combined with the overwriting of P-frames, 
motion vector manipulation, or object manipulation. If combined use is made of these 
techniques, the nature of the combination may be made a composite function of the 
degrade level. For example, motion vector manipulation and object manipulation may 

25 be reserved for higher degrade levels, with lower levels of degradation being 
implemented with I-frame noise insertion or P-frame overwriting. 

Having described a number of digital audio/video signal degradation 
techniques particularly suitable for implementation with a DSP, some analog-based 
techniques for degrading digital audio/video signals are now described. 

30 Figure 24 shows the intemal structure of the signal processing unit 137 

according to a first example which is generic to a number of analog-based audio and 
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video degradation techniques. As illustrated in Figure 24, a digital data stream is 
received through the input 8 and converted into an analog signal by a data converter 
1000. The thus converted analog signal is then passed to an analog processing unit 
1200 responsible for degrading the audio or video content quahty. The amount of 
5 degradation is dependent on the degrade level signal 139e input to the analog 
processing unit 1200. The degraded analog signal is then supplied to a data converter 
1400, where it is converted into digital form conforming to the same standard as the 
input digital data stream received at the input 8. The degraded digital data stream is 
then supplied to the signal processing unit output 16 for output to the client 120 

10 through the communication hnk 160. 

For audio signals, the analog processing unit 1200 may, for example, act as a 
frequency domain modulator. 

One form of frequency domain modulation that may be used is band-reject 
filtering, sometimes referred to a notch filtering. The center frequency and passband 

15 width of the band-reject filter can be selected based on a pseudo-random number 
sequence with a very long period. The audio stream can then be processed with a 
notch filter to change its spectral characteristics. In addition, the center frequency and 
passband width can be changed periodically. 

Another form of frequency domain modulation that may be used is low-pass 

20 filtering to remove, or attenuate, spectral components above a selected frequency. If 
the high-frequency components are attenuated, rather than being removed, high- 
frequency noise is preferably added to prevent restoration of the high quality original 
signal by a filter which compensates for the attenuation. Instead of, or as well as, low- 
pass filtering, the analog processing unit 1200 may be configured to perform high-pass 

25 filtering, or attenuation below a selected frequency. Similar design considerations 
apply as for low-pass filtering. 

In the above frequency domain modulation examples, the degrade level can be 
used in determining the range of removed or attenuated frequencies according to the 
subjective significance of the frequencies concerned to a listener. 

30 For video signals, the analog processing unit 1200 is operable to modulate an 

analog video signal. 
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In one example, the analog processing unit 1200 includes an impedance 
discontinuity which results in "ghosts" in the processed video signal by inducing 
transmission line reflections. The size of the impedance discontinuity can be made 
variable according to the degrade level signal 139e, 
5 In another example, the analog processing unit 1200 acts to insert a time delay 

in the analog TV signal between the sync pulse and part or all of the following 
brightness-conveying signal. The analog processing unit 1200 may include a sync 
pulse detector and a delay line connected to receive a sync pulse detection signal from 
the sync pulse detector, the delay line being responsive to the sync pulse detection 

10 signal so as to lengthen the back porch part of the signal by a duration proportional to 
the degrade level signal amplitude, thereby to vary the blanking period. This can be an 
effective method of signal degradation, since the relative position of the sync pulse to 
the following brightness signal is critical for good interlace in the displayed picture. 

Figure 25 shows a second example of the intemal structure of the signal 

15 processing unit 137. On the input side, the digital data stream is received through the 
input 8 and rendered into an analog signal by a data converter 1000. On the output 
side, there is a data converter 1400 for reconstituting the digital data stream, the 
converter 1400 being arranged to supply the digital data stream to the output 16. The 
degrade level signal 139e is received as a further input. A signal generator 1800 is 

20 provided, the output of which is suppUed to an amplifier 2000. The gain of the 
amplifier 2000 is controlled by the degrade level signal 139e. The output of the 
amplifier 2000 is received at one input of a mixer 2200, the other input of which 
receives the high-fidelity data stream. The mixer 2200 thus serves to mix the high- 
fidelity signal with a secondary signal generated by the signal generator 1800. The 

25 level of the signal contribution received from the signal generator 1800 is determined 
by the gain of the ampUfier 2000, which is in tum determined by the degrade level 
signal 139e. Finally, the output of the mixer 2200 is supplied, through the data 
converter 1400, to the signal processing unit output 1600 to the client 120. The signal 
generator, ampUfier and mixer are analog components in this example. An analog-to- 

30 digital converter (not shown) may be required to convert the degrade signal 139e into 

analog form prior to supply to the amplifier 2000. 
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The signal generator 1800 may be a source of noise. For example, the signal 
generator 1800 may be a pseudo-random noise generator with a very long period used 
to generate low level audible noise with desired spectral and/or temporal 
characteristics. Especially for classical audio recordings, the noise generator may 
5 generate one or more of the rumble, hiss and popping sounds of an old, possibly 
scratched, vinyl or acetate recording. In the case of a video signal, the addition of 
random noise generated by the signal generator 1800 can be used to cause "snow" in 
the degraded picture. 

In the case of audio signals, as an alternative to noise, the signal generator 1800 
10 may be a source of a secondary audio signal, for example a speech bearing signal. In 
the case of a music product, the speech signal generated by the signal generator 1800 
can thus be added to cause a voice-over of the music, thereby spoiling the appreciation 
of the music. This could be achieved with a D.J. voice-over for popular beat music or 
a monotonic nasal announcer for classical music. The music can thus be rendered 
15 unusable for high quality listening, while still allowing the listener to verify that the 
correct audio stream has been selected, and that the music is worthy of purchase. 

Figure 26 shows a further alternative structure for the signal processing unit 
137. An n-channel digital audio/video signal is received at the input 8 and is decoded 
and converted to analog form by a data converter 1000. A mixer 3200 is arranged to 
20 receive and mix the n-channel analog audio/video signal. The mixed signal is then 
digitized by a data converter 1400 arranged on the output side of the mixer 3200, the 
data converter 1400 being arranged to supply the mixed digital video/audio signal to 
an output 16. 

In the case of an audio data stream consisting of two or more channels, the 

25 channels can be mixed to produce a monophonic playout. 

In the case of a video signal, the mixer 3200 can serve to logically OR the RGB 

color channels to obtain a UVB monochrome signal for output to the output 16. 

The example of Figure 26 may be modified by replacing the mixer 3200 with a 

channel attenuator or remover. For example, x channels of the n-channel signal can be 

30 removed or attenuated. For a multi-channel audio recording, channel removal may 

serve to remove one or more instruments from the multi-track recording. 
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Figure 27 shows a further example of the internal structure of the signal 
processing unit 137 suitable for processing digital audio signals. The input 8 is 
connected to a data converter 1000 for converting the digital audio signal into an 
analog audio signal. The data converter 1000 is connected to a frequency separator 
5 3600 operable to separate the analog audio signal into a pluraUty of spectral frequency 
bands. The separate frequency bands are then supplied to a phase inversion unit 3800 
comprising a plurality of filters 3900, one for each of the frequency bands. The 
degrade level signal 139e serves as a control signal for activating selected ones of the 
filters 3900 so as to apply phase inversion to none, one or more of the frequency 

10 bands. After processing by the inversion unit 3800 the separate frequency band 
signals are applied to a frequency combiner 4000 where the analog signal is re- 
constructed and then supphed to the output 16 after digitizing in data converter 1400. 
The frequency bands selected for phase inversion may be varied with time, for 
example in a random or pseudo-random fashion, or by sequential polling, thereby to 

15 provide a further subjective impression of quality degradation in the output signal. In 
its simplest form, there may be provided only a single filter 3900 for phase inversion 
of one of a pluraUty of frequency bands. 

With any of the above-described digital or analog based degradation apparatus 
and processes, the following decoder apparatus and methods may be used to further 

20 enhance security against repeated playing or a pre-purchase digital audio or video 
product supplied over a network connection. 

Figure 28 shows an output stage of the server 130. The output stage is 
arranged to receive and packetize the stream of digital video/audio data received from 
the signal processing unit 137 on the communication line 16. The output stage 

25 comprises a packetizer 56 and a key generator 58. The packetizer 56 separates the 
data stream into data packets 54, wherein the data in each data packet 54 is encoded 
using a encryption key An, Bn.... allocated by the key generator 58, which includes a 
pseudo-random number generator for generating the keys. The encrypted data in the 
data packets 54 can be decrypted with a suitable decoder 55 in combination with the 

30 associated encryption key. The server 130 supphes, or "ships ahead", the decoder 55 

to the client 120 prior to transmission of the data packets 54 containing the degraded 
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digital video/audio product. The decoder 55 is supplied by the dialogue unit 135 
through communication line 57. A number of different decoders 55 can be held in the 
file store 131, and the dialogue unit 135 configured to change the decoder periodically. 
Figure 29 shows the corresponding decrypting input stage at the client 120, 
5 The decoder 55 which has been shipped ahead is loaded into a decoder unit 122 for 
decoding the data packets 54 and re-creating a data stream suitable to be played by the 
video or audio player. The packet stream is received at the input of the client 120 
through the communication Une 160 and the encryption key An is read by the decoder 
unit 122 which decodes the data of the packet according to the packet's key value. 
10 The decoded data is then supplied to a delay line 126 and to a corruption unit 124. The 
Q corruption unit 124 has a pseudo-random number generator and is arranged to add a 

pseudo-random number to the encryption key of each data packet 54, thereby 
P overwriting the true key. The delay line 126, which may be latched by the action of 

ij\ the corruption unit 124, is configured so that output of the decoded digital data stream 

15 associated with any given packet to the player does not occur until the key of the 
corresponding data packet has been overwritten by the corruption unit 124. 
g The ship-ahead decoder described above with reference to Figure 28 and 

Figure 29 thus allows the product to be played only once, or for a limited number of 
3 plays or a limited time period, and prevents further repeated playing of the video or 

20 audio product supplied only for the purpose of pre-purchase evaluation. This is 
especially useful in combination with degradation of the content quahty at the server 
130, but it will be understood that the play-once ship-ahead decoder design may also 
be used without degradation to supply a high-fidelity pre-purchase sample of a 
product. In the context of the server 130 as illustrated in Figure 2, the packetizer 
25 would then be arranged as an output stage of the reader 134 and the signal processing 
unit 137 and control switch 136 omitted. 

Although a particular combination has been described for the play-once ship- 
ahead decoder, there are clearly other commercially available types of software 
decoders that allow for single or multiple uses or use for a limited time period that may 
30 be employed within the concepts of the present invention. 

It will be appreciated that although particular embodiments of the invention have 
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been described, many modifications/additions and/or substitutions may be made within 
the spirit and scope of the present invention. 
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Claims 



1. 



A server for a merchant computer system, the server comprising: 



a file store configured to store a range of audio/video products in 



5 respective product files; 



a dialogue unit operable to invite and receive a client selection from 



among the products; 



10 



a product reader connected to read the product files from the file store 



to generate a digital audio/video signal; and 

a signal processing unit having an input selectively connectable to 
receive the digital audio/video signal from the product reader, a processing core 
15 operable to apply a defined level of content degradation to the digital audio/video 
signal, and an output connected to output the degraded digital audio/video signal. 

2. A server according to claim 1, wherein the dialogue unit is operable to 
generate a degrade level signal, the signal processing unit having a degrade level 

20 signal input for receiving a degrade level signal from the dialogue unit and being 
operable to vary the degradation level responsive to the degrade level signal. 

3. A server according to claim 2, wherein the degrade level signal is 
dependent on a cUent integrity indicator determined from a personal client file 

25 containing client history data stored in the file store. 

4. A server according to claim 2, wherein the degrade level signal is 
dependent on an authorization response received by the dialogue unit from a remote 
payment gateway computer system following an authorization request from the 

30 dialogue unit including a client i.d., a cUent payment instrument and a monetary value 
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of the product selected for evaluation. 

5. A server according to claim 1, wherein the processing core comprises a 
digital signal processor. 

5 

6. A server according to claim 5, the digital signal processor including a 
delay line structure having an input arranged to receive a bit stream derived from the 
digital audio/video signal, noise insertion circuitry for manipulating bits of the bit 
stream to degrade signal quaUty, and an output arranged to output the manipulated bit 

10 stream. 

7. A server according to claim 5, the digital signal processor including: 

a discrete Fourier transform unit operable to apply a discrete Fourier 
transform to obtain a frequency domain representation of the digital audio/video 
15 signal; 

a frequency modulator operable to apply a manipulation process to the 
frequency domain representation of the digital audio/video signal; and 

an inverse discrete Fourier transform unit operable to apply an inverse 
discrete Fourier transform to reconstruct a time domain representation of the digital 
20 audio/video signal. 

8. A server according to claim 7, wherein the manipulation process 
applied by the frequency modulator is such as to effect a degradation of perceived 
signal quaUty in the digital audio/video signal reconstructed by the inverse digital 

25 Fourier transform unit. 

9. A server according to claim 8, wherein the manipulation process 
includes one or more of the following: frequency band rejections, frequency low pass 
and frequency high pass. 

30 



10. 



A server according to claim 8, wherein the manipulation process 
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includes phase inversion over at least one range of frequency components. 



11. A server according to claim 7, wherein the manipulation process 
applied by the frequency modulator is applied to digital audio signals and inserts 

5 masked sound contributions adjacent ampUtude peaks of the frequency domain 
representation of the digital audio signal. 

12. A server according to claim 7, further including a mixer operatively 
arranged before the discrete Fourier transform unit. 

10 

13. A server according to claim 12, wherein a frequency modulator is 
operatively arranged between the mixer and the inverse discrete Fourier transform 
unit, and the manipulation process includes band-pass filtering to suppress frequency 
contributions lying outside a selected frequency range. 

15 

14. A server according to claim 13, wherein the manipulation process 
inserts masked sound contributions adjacent the mixing frequency, 

15. A server according to claim 5, the digital signal processor including: 
20 a frame buffer for holding frames of a digital video signal; and 

a frame manipulator operatively arranged to manipulate frames in the 
frame buffer to generate a degraded digital video signal. 

16. A server according to claim 15, wherein the digital signal processor is 
25 configured to process digital video signals conforming to an MPEG standard including 

as frame types I-frames, P-frames and B-frames, wherein the frame manipulator is 
operable to identify the frame type of frames held in the frame buffer, and operable to 
perform frame manipulation according to frame type so as to degrade video signal 
quality. 

30 



17. 



A server according to claim 15, wherein the digital signal processor is 
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configured to process digital video signals conforming to an MPEG standard including 
data blocks, each comprising a plurality of pixels, wherein the frame manipulator is 
operable to vary the pixels of the data blocks of at least selected ones of the frames so 
as to degrade video signal quaUty. 

5 

18, A server according to claim 15, wherein the digital signal processor is 
configured to process digital video signals conforming to an MPEG standard including 
motion vectors, wherein the frame manipulator is operable to vary the motion vectors 
of at least selected ones of the frames so as to degrade video signal quality. 

10 

19, A server according to claim 15, wherein the digital signal processor is 
configured to process digital video signals conforming to an MPEG standard including 
objects, wherein the frame manipulator is operable to manipulate the objects of at least 
selected ones of the frames so as to degrade video signal quality. 

15 

20, A server according to claim 1, wherein the processing core is operable 
to process a multi-channel digital audio signal by switching individual channels within 
the multi-channel signal to apply spatial modification to the digital audio signal. 

20 21. A server according to claim 1, wherein the processing core is operable 

to process a multi-channel digital audio signal by inverting the phase of at least one of 
the audio channels. 

22. A server according to claim 1, wherein the processing core is operable 
25 to process a multi-channel digital audio/video signal by adding together individual 

ones of the channels. 

23. A server according to claim 1, wherein the processing core is operable 
to process a multi-channel digital audio/video signal by removal or attenuation of at 

30 least one of the channels. 
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24. A server according to claim 1, wherein the digital audio/video signal 

comprises an n-bit digital audio signal and the processing core is operable to convert 
the n-bit digital audio signal into an m-bit digital audio signal where m is less than n. 

5 25. A server according to claim 1, wherein the processing core is operable 

to time modulate the digital audio/video signal. 

26, A server according to claim 25, wherein the time modulation is one or 

more of: 

10 a speed-up or slow-down the digital audio/video signal; 

a change in the value of data bits in volume, luminance or chrominance 
data contained within the digital audio/video signal; and 

a lengthening of a sampling period of the digital audio/video signal. 

15 27. A server according to claim 1, wherein the processing core comprises: 

a first data converter arranged as an input stage to convert the digital 
audio/video signal into an analog audio/video signal; 

an analog processing unit operable to apply a defined level of 
audio/video degradation to the analog signal; 
20 a second data converter arranged as an output stage to convert the 

degraded analog signal into a degraded digital audio/video signal for output. 

28. A server according to claim 27, wherein the analog processing unit is 
operable to apply frequency domain modulation to an analog audio signal. 

25 

29. A server according to claim 28, wherein the frequency domain 
modulation is one or more of: band-reject filtering, low-pass filtering, high-pass 
filtering and frequency-selective phase inversion. 

30 30. A server according to claim 1, wherein the processing core comprises a 

mixer for adding a secondary signal to the digital audio/video signal. 
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31. A server according to claim 30, wherein the signal processing unit 

further comprises a signal generator for generating the secondary signal. 

5 32. A server according to claim 31, wherein the signal generator is operable 

as a noise generator. 

33. A server according to claim 31, wherein the signal generator is operable 
to generate a content-based audio signal 

10 

34. A server according to claim 30, when appended to claim 2, wherein the 
level of the secondary signal mixed with the digital audio/video signal is determined 
by the degrade level signal. 

15 35. A method of operating a server of a merchant computer system, the 

method comprising: 

inviting a cUent to make a selection from a range of audio/video 
products stored by the server in product files; 

receiving a client selection for evaluation of one of the products; 
20 reading the selected product file to generate a digital audio/video signal; 

applying a defined level of content degradation to the digital 
audio/video signal to generate a degraded digital audio/video signal; and 

outputting the degraded digital audio/video signal to the client. 

25 36. A method according to claim 35, wherein the level of content 

degradation applied is dependent on a client integrity indicator determined from a 
personal cUent file containing cUent history data. 

37, A method according to claim 35, wherein the level of content 

30 degradation applied is dependent on an authorization response received by the server 

from a remote payment gateway computer system following an authorization request 
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by the server including a client i.d., a client payment instrument and a monetary value 
of the product selected for evaluation. 

38. A method according to claim 35, utilizing a digital signal processor to 
5 apply the defined level of content degradation to the digital data stream. 

39. A method of conmiunicating between a client, server and gatev^ay on a 
computer network, the method comprising: 

10 a) the client establishing communication with the server to identify the 

client and a cUent payment instrument to the server; 

b) the server transmitting to the client a range of audio/video products for 
supply in return for payment; 

15 

c) the cUent transmitting to the server an evaluation request for one of the 
products; 

d) the server and gateway communicating to obtain payment authorization 
20 for the requested product from the payment instrument; 

e) the server transmitting to the client a degraded evaluation version of the 
selected product; 

25 f) the client transmitting to the server a payment decision; 

g) the server and gateway communicating to effect payment capture for 
the authorized payment; and 

30 h) the server transmitting to the client a non-degraded version of the 

selected product, 
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40. The method of claim 39, wherein said evaluation version is degraded as a 
function of a client history. 

5 41, The method of claim 39, wherein said evaluation version is degraded as a 
function of said chent payment instrument. 

42. A server apparatus comprising: 

means for supplying a range of audio/video products as respective 
10 digital audio/video signals; 

means for inviting and receiving a client selection from among the 
products via a network connection; and 

means for processing the digital audio/video signal associated with the 
selected product to apply a defined level of content degradation thereto; and 
15 means for outputting the degraded digital audio/video signal to the 

network connection, whereby a degraded version of the selected product is supplied to 
the chent, 

43. A merchant computer system comprising a server and a client 
20 interconnectable over a network, wherein the server comprises: 

a file store configured to store a range of audio/video products in 
respective product files; 

a dialogue unit having a network connection and operable to invite and 
receive a client selection from among the products via the network connection; 
25 a product reader connected to read the product files from the file store 

to generate a digital audio/video signal; and 

a signal processing unit having an input connectable to receive the 
digital audio/video signal from the product reader, a processing core operable to apply 
a defined level of content degradation to the digital audio/video signal, and an output 
30 connected to output the degraded digital audio/video signal from the processing core to 
the network connection. 
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44 The system of claim 43, wherein the client comprises an audio/video 

reproduction system operable to play the audio/video product communicated by way 
of the digital audio/video signal. 

5 

45, The system of claim 43, the server further including an output stage 
operatively arranged between the output of the signal processing unit and the network 
connection, the output stage having a packetizer for sub-dividing the degraded digital 
audio/video signal into encrypted data packets and associating decryption keys with 

10 each encrypted data packet, the dialogue unit being operable to supply a packet 
decoder to the client over the network for decoding the digital video/audio signal, and 
wherein the chent includes an input stage connected to receive the packet decoder and 
load the packet decoder into a decoder host, the chent input stage further comprising 
an input connected to receive the data packets and supply the data packets to the 

15 decoder host for packetwise decoding by applying the packet decoder with the 
associated decryption key of the data packet concerned, wherein the client input stage 
is configured to corrupt the decryption key of any given data packet before the 
decoded data of that packet is transmitted from the input stage in a form playable by 
the reproduction system. 

20 

46. A method of communicating between a client, server and gateway on a 
computer network, the method comprising: 

a) the client establishing communication with the server to identify the 

25 client; 

b) the server transmitting to the chent a range of audio/video products for 
supply in return for payment; 



30 



c) 

products; 



the client transmitting to the server an evaluation request for one of the 
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d) the server transmitting to the client a degraded evaluation version of the 
selected product; 

5 e) performing steps b) through d) at least once; 

f) the client transmitting to the server a purchase decision and 

payment instrument; 

10 g) the server and gateway communicating to obtain payment 

authorization for the requested product from the payment instrument; 

h) the server and gateway communicating to effect payment capture for 
the authorized payment; and 

15 

i) the server transmitting to the client a non-degraded version of the 
selected product. 
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Abstract 



Supply Of Digital Audio And Video Products 

A server for a merchant computer system, the server comprising: a file store for 
storing a range of audio/video products in respective product files; a dialogue unit 

5 having a network connection and operable to invite and receive a client selection from 
among the products via the network connection; a product reader for reading the 
product files to generate a digital audio/video signal; a digital signal processing unit 
having an input connectable to receive the digital audio/video signal from the product 
reader, a processing core operable to apply a defined level of content degradation to 

10 the digital audio/video signal, and an output connected to output the degraded digital 
audio/video signal from the processing core to the network connection. It is therefore 
possible for a content provider to change the characteristics of an audio or video data 
stream supplied over a network to a potential purchaser in a controlled and variable 
manner. The amount of degradation is sufficient to enable a potential purchaser to 

15 appreciate the characteristics of the audio or video product, whilst reducing the 
perceived quality. 



Fig. 2 



TI-27109 



-46- 



1/20 



140 



130 



160 



120^ 



21 



150 



a 



MERCHANT 




PAYMENT 




f — > 


BANK 


(SERVER) 


•)■ 


GATEWAY 






(HOST) 



170 



180 



CUSTOMER 
(CLIENT) 



Fig. 1 



TI-27109 



2/20 



130 



1 31-^ 

rUUZ 

132/^133 



134 



READER 



136 



135 
U 



■138 



DIALOGUE 



137 



16"^ 



139 



SIGNAL 

Iprocessing 



T 




160 



V 



Fig. 2 



TI-27109 



3/20 




Fig. 3 



■8 



12 



DEGRADE 



LEVEL 

139 




DECODE 



DSP 

502l 



FFT 



r 



52 



INV 

lEL 



-10 



ENCODE 



-14 



-16 



TI-27109 



4/20 



Fig. 5A 



Fig. 5B 




II 



Fig. 5C 



'4^ 



fn 



MiN 



1^- 



Fig. 5E 

A'. 



n n n 



Fig. 5D 



A' 



t~t' 



Fig. 5F 



A' 



Fig. 6A A 



Fig.6B A 



ll 



ll 



TI-27109 



5/20 



Fig.7A 



8 




69-^ 



a. 



9 O • 1 



UNARY CONVERTER 
T 




-135 

DEGRADE LEVEL (0 7) 



Fig. 7B 



IN 
FB 

MOD 

MOD 

(OR) 



n 



n 



n_j — L_n_j Lf 



Jl—TL. 

i i 



U L_ 



TI-27109 



6/20 



Fig. 8 



IN 



18 VI 



20 



DEGRADE 




DEGRADE 
LEVEL 




■NO DEGRADE 

-139a 

n-channel IN 




CLK 



26 



n 30 



n 



RECOK 


1PUTE 






n > 
■ IRAN 
FUNC 


[ n 

SFER 
TiON 



28 




■16 



Fig. 9 



n-channel OUT 
TI-27109 



7/20 



Fig. 10 

n-CHANNEL IN 



9 9 9 9 




MONO OUT 



Fig. 11 

n-bit IN 

8-^ 



m REQUANT 



m bit OUT 



8/20 




TI-27109 



9/20 

Fig. 13 



f 



I 



y/. 

/ 



t. 



I 



t. 



A(in) 



Fig. 14A 

A, — A, 
A 



Fig. 14B 



A, 



A(out) 



A. 



TI-27109 



10/20 



Fig. 15 
A 



A 


m — t 








> 


























I T T 



Af 



Fig. 16 
A 



A,.. 



1 ^ 



I 

1 



t I .1- 
jAA 



Af 



TI-27109 



11/20 




Fig. 17 
50-- 51 



52 



16 



Fig. 18A 





FFT 




FILTER 


^ 


INV 
FFT 


>< 


) — ^ 


^ 







Fig. 18B 



max 



mm 



m 



max 



TI-27109 



12/20 



Fig. 15 

GOP 



I, 






PjBslBs 


PtIBbIBs 




B„lB„|I,|B2 



Fig. 20 



139b 



DEGRADE/^ 




47- 



LEVEL 



^CONTROL 


CLK 


INPUT 
BUFFER 









CLK 



46 



OUTPUT 
BUFFER 



48 



-16 



r - T 



B_6 'P7I 



B, 



ll 



TI-27109 



13/20 



Fig. 21 



72 



139c 

DEGBML 
LEVEL 



MOTION 
VECTOR 
MANIPUL- 
ATION 



8 



^ — 

FRAME 
BUFFER 



46 



16 



139d 

DEGRADE 



LEVEL 



Fig. 22 



76 



PSEUDO- 
RANDOM 
SIGNAL 
GENERATOR 



-8 



FRAME 




1 

FRAME 


I.D. 




BUFFER 



46 




TI-27109 



14/20 



78 



Fig. 23 



OBJECT 
I.D. 



INPUT 
BUFFER 



OBJECT 
MANIPULATION 



OUTPUT 
BUFFER 



TI-27109 



15/20 



Fig. 24 



8 



IN 

9 



DATA 
CONVERTER 



■1000 



139e 

DEGRADE 



LEVEL 



ANALOG 
PROCESSOR 



■1200 



DATA 
CONVERTER 



•1400 



OUT 



16 



TI-27109 



16/20 



Fig. 25 



8 



1000 


2200 


1400 


DATA 






DATA 


CONVERTER 




f — 


CONVERTER 



1800 2000 




DE GRADE 

LEVEL ) 

^139e 



TI-27109 



17/20 
Fig. 26 

IN 



1000 



DATA 
CONVERTER 



3200 















MIXER 







1400 



DATA 
CONVERTER 



MONO 
OUT 



TI-27109 




139e 



FREQUENCY 
SEPARATOR 



FREQUENCY 
COMBINER 



1000 



3600 




3800 



4000 




1400 




TI-27109 



19/20 



Fig, 28 




TI-27109 



20/20 




TI-27109 



ATTORNEY'S DOCKET NO. 
TI-27109 



PAGE 1 OF 1 

APPLICATION FOR UNITED STATES PATENT 
DECIiARATION AND POWER OF ATTORNEY (UNSIGNED) 

AS a below named inventor, I declare that my residence, post office address and citizenship 
are as stated below next to my name; that I verily believe that I am the original first 
and sole inventor if only one name is listed below, or an original, first and joint 
inventor if plural inventors are named below, of the subject matter which is claimed and 
for which a patent is sought on the invention entitled as set forth below, which is 
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statements made on information and belief are believed to be true, and further that these 
statements were made with the knowledge that willful false statements and the like so made 
He punishable by fine or imprisonment, or both, under section_ 1001 of Title 18 of the 
Ifiited States Code, and that such willful false statements may jeopardize the validity ot 
glLe application or any patent issuing thereon. 



"ii^ITLE OF INVENTION: 



Supply of Digital Audio and Video Products 



. FOWER OF ATTORNEY : 



I HEREBY APPOINT THE FOLLOWING ATTORNEYS TO PROSECUTE THIS APPLICATION AND TRANSACT ALL 
BUSINESS IN THE PATENT AND TRADEMARK OFFICE CONNECTED THEREWITH 



Frederick J. Telecky, #29,979; Jay M. Cantor, #19,906; C. Alan McClure, #31.041; William B Kerrpler, 
-^:28i28rRobert D. Mar^kl, #28, 527 ; Gerald E. Laws, 39,268; James F. Hollander, #27,802; Robby Holland, 
=33,304; Rebecca Maps tone-Lake, #36,208. 



===SEND CORRESPONDENCE TO: 



C. Alan McClure 

Texas Instruments Incorporated 
P.O. Box 655474, MS 3999 
Dallas, TX 75265 



DIRECT TELEPHONE CALLS TO: 

C. Alan McClure 
(281) 274-4064 



NAME OF INVENTOR: 
David R. Thomas 



(1) 



NAME OF INVENTOR: 
Edwin Randy Cole 



(2) 



RESIDENCE & POST OFFICE ADDRESS: 
13 Chmn du Hois d'Opio 
06650 Opio 
France Cedex 



RESIDENCE & POST OFFICE ADDRESS: 
4540 Fairway Street 
Highland Park, Texas 75219 

USA 



COUNTRY OF CITIZENSHIP: 
UK 



COUNTRY OF CITIZENSHIP: 
USA 



coum^y ' bF -ciTiizsNSHip / ; ■ 



SIGNATURE OF INVENTOR: 



DATE: 



SIGNATURE OF INVENTOR: 



DATE: 



